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ACCURACY  AND  CERTITUDE  IN  THE  DISCRIMINATION  OF  VISUAL  NUMBER 


THE  PROBLEM 

d 

The  COMMAND  SYSTEMS  Task  is  conducting  several  projects  to  determine 
how  accuracy  of  information  assimilation  from  displays  of  the  type  used  in 
tactical  operation  centers  and  the  certitude  the  viewer  has  about  this 
accuracy  vary  jointly  and  separately  as  a  function  of  the  manipulation  of 
various  information  presentation  variables. 

There  is  little  in  the  literature  bearing  directly  on  this  area  of 
inquiry,  although  several  studies  over  the  years  have  involved  numerousness 
(discrimination  of  visual  number)  for  tachistoscopically  presented  stimuli 
in  which  performance  data,  and  sometimes  certitude  data,  were  obtained 
(Kaufman,  Lord,  Reese,  and  Volkman,  19^9;  Minturn  and  Reese,  1951;  Saltzman 
and  Garner,  19 J+8 j  Taves,  19^1).  Fields  of  dots  seem  to  be  the  most  popular 
stimuli  for  such  studies;  concentric  circles,  numerals,  and  colors  have 
been  used.  Generally,  the  functions  characterizing  the  relationship 
between  estimated  and  actual  number,  between  errors  in  estimated  number  and 
actual  number,  and  between  certitude  and  actual  number  have  been  similar 
across  studies.  However,  the  majority  of  the  studies  have  not  included 
measures  of  certitude,  and  none  to  the  author's  knowledge  have  directly 
compared  errors  in  the  judgment  of  number  with  certitude  about  this  judgment. 

1  A  common  finding  from  these  studies  seems  to  be  that  estimates  of 
number  of  things  presented  and  certitude  plotted  as  a  function  of  the  actual 
number  of  things  presented  are  in  effect  discontinuous  functions  with  the 
break  in  continuity  occurring  between  6  and  8  things  presented.  Such  a 
finding  has  given  rise  to  the  postulation  of  at  least  two  distinct  mecha¬ 
nisms  :  subitizing  (immediate  apprehension)  and  estimating.  A  third  cate¬ 
gory,  counting,  is  excluded  as  a  mechanism  in  such  brief  exposures. 

A 

The  extent  to  which  reported  research  can  provide  insights  into  the 
processes  involved  in  more  complex  information  extraction  and  differing  ex¬ 
posure  times  is  not  known.  Nor  is  it  known  whether  the  same  people  would 
excel  in  performance  under  varying  conditions  or  whether  the  certitude  - 
performance  relationship  would  generalize  across  information  extraction 
tasks.  While  the  determination  of  this  information  is  not  an  integral  part 
of  the  COMMAND  SYSTEMS  Task  research  program,  such  information  could  be  of 
considerable  value  in  understanding  the  nature  of  the  psychological  processes 
involved  in  extraction  or  assimilation  of  information  from  displays. 

A  brief  exploratory  probe  was  conducted  as  an  aid  in  deciding  whether 
more  intensive  study  in  this  area  would  produce  sufficiently  beneficial 
results  to  justify  the  effort.  The  study  was  conducted  prior  to  a  non- 
tachistoscopic  experiment  in  which  certitude  and  accuracy  of  information 
assimilation  from  visual  displays  as  a  function  of  amount  of  information 
presented  and  removed  in  slide  updating  were  studied.  Since  the  same  sub¬ 
jects  were  used  in  the  succeeding  nontachistoscopic  experiment,  the  present 
study  related  performance  across  tasks  to  the  extent  feasible. 
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PURPOSE 


The  general  purpose  of  this  study  was  a  preliminary  determination  of 
the  degree  to  which  findings  reported  in  the  literature  regarding  discrimi¬ 
nation  of  visual  number  and  the  psychological  mechanisms  related  thereto 
are  sustained  for  certain  variables  of  interest  in  Command  Systems  research. 
More  specifically,  the  objectives  were: 

1.  to  determine,  for  tachistoscopically  presented  symbols,  how  dis¬ 
crimination  of  visual  number  and  subjective  feelings  of  certitude 
about  that  discrimination  are  affected  by  (l)  number  of  symbols 
displayed  (k  to  22  per  slide),  (2)  exposure  time  (200  and  500 
milliseconds),  and  (3)  order  of  exposure  time  (200  ms  before 
500  ms  vs  500  ms  before  200  ms). 

2.  to  determine  how  the  relationship  of  degree  of  error  to  certitude 
varies  as  a  f 'unction  of  variations  in  amount  (number  of  symbols), 
exposure  time,  and  order  of  exposure  time. 

3.  to  compare  findings  of  the  above  analysis  for  tachistoscopic 
presentations  with  findings  for  nontachistoscopic  presentations 
using  the  same  subject. 


METHOD 


EXPERIMENTAL  DESIGN 

Independent  variables  investigated  in  the  present  study  were  total 
number  of  symbols  in  the  slide  (amount),  duration  of  exposure  of  the  slide 
(exposure  time),  ar.d  order  of  presentation  at  two  exposure  times  (order). 

Nine  amount  levels--'!-,  5,  6,  7,  8,  10,  Ik,  18,  and  22  elements  per 
slide--were  randomly  presented.  In  order  A,  the  nine  slides  were  presented 
at  500  ms  duration  of  exposure  followed  by  the  same  nine  slides  in  different 
order  and  orientation  (upside  down)  at  20 0  ms  duration.  In  order  B,  the 
subjects  were  shown  the  slides  at  ^>00  ms  first.  Subjects  were  randomly 
divided  into  two  order  groups  e.:.oh  of  which  received  all  possible  combina¬ 
tions  of  amount  and  exposure  times. 


SUBJECTS 

Subjects  were  32  male  college  graduates  having  normal  or  corrected 
normal  vision.  These  subject  criteria  are  consistent  with  the  character¬ 
istics  typical  of  Army  officers  operating  in  a  Tactical  Operations  Center. 
Since  the  study  did  not  deal  with  stimulus  material  that  required  military 
sophistication  and  the  variables  were  primarily  perceptual,  subjects  were 
chosen  from  professions?  and  technical  personnel  at  USAFR0.  In  future 
studies  in  this  series  as  military  material  is  included  in  the  stimulus 
continuum,  military  su  jects  will  be  included  in  the  sample. 
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STIMULUS  MATERIAL 


The  slides  used  as  stimulus  material  were  35 -cm  negative  transparen¬ 
cies  containing  a  number  of  identical  flag  symbols  which  appeared  as  white - 
line  drawings  on  a  dark  background  ( ca>-  The  symbol  is  one  commonly  used 
to  identify  infantry  units  on  military  maps. 

A  130-cell  grid  was  used  to  randomly  determine  the  location  of  the  flag 
symbols  for  each  amount  level.  Obvious  and  meaningful  patterns  were  avoided. 
The  symbols  when  projected  on  the  screen  were  approximately  2-1/3  x  1-5/8 
inches.  To  control  at  least  in  part  for  "location"  effects  (any  facility 
or  difficulty  in  the  task  due  to  the  location  of  the  symbols  in  the  slide), 
each  slide  was  systematically  presented  at  one  time  right  side  up  and  at  the 
next,  upside  down.  This  procedure  was  accomplished  without  loss  in  symbol 
recognition,  since  the  symbols  are  preceptually  the  same  when  subjected  to 
reorientation.  The  various  orientations  which  allowed  the  symbols  to  appear 
in  different  areas  of  the  slide  increased  the  economy  of  slide  production 
and  the  generalization  value  of  the  findings. 

The  slide  projector  used  had  a  300-watt  lamp  with  a  3"  wide-angle  lens. 
The  slides  with  projected  image  area  4'  x  6'  were  rear  projected  on  a 
6'  x  8'  screen  which  was  bisected  vertically  and  horizontally  by  crosshairs. 
The  subject's  work  area  was  illuminated  by  an  indirect  overhead  lamp,  rheo- 
statically  adjusted  to  insure  enough  light  to  read  the  response  sheet,  to 
reduce  the  possibility  of  after-images,  and  yet  not  interfere  with  the 
presented  image.  Based  on  MacBeth  Illuminometer  readings,  the  level  of 
illumination  on  the  work  surface  was  1.5  foot  candles.  The  average  luminance 
value  of  the  indicated  symbols  on  the  screen  was  .4  foot  lambert.  These 
levels  were  maintained  across  all  subjects  and  all  conditions. 


EXPERIMENTAL  PROCEDURES 

The  32  subjects  were  randomly  divided  into  eight  groups  of  four  sub¬ 
jects  each.  The  four  subjects  in  each  group  were  seated  15  feet  from  the 
viewing  screen,  and  slide  material  was  presented  simultaneously  to  all 
four.  This  procedure  permitted  group  data  collection  and  provided  some 
simulation  of  group  display  practices  in  a  Tactical  Operations  Center. 

All  subjects  were  given  the  follSwing  instructions  regarding  the  task: 

"In  this  first  part  of  today's  session,  you  will  be  shown  a 
series  of  slides,  one  at  a  time.  Each  slide  will  be  flashed  on 
the  screen  for  only  a  moment - -actually  less  than  1  second.  You 
are  to  watch  the  screen  as  closely  as  possible  in  order  to  de¬ 
termine  how  many  flag  symbols  are  shown  on  a  particular  slide. 

While  waiting  for  a  slide  to  appear,  you  should  focus  your  atten¬ 
tion  at  the  intersection  of  crosshairs  on  the  screen.  The  center 
of  each  slide  shown  will  be  at  that  point.  After  a  slide  has  been 
presented,  you  are  to  write  on  your  answer  sheet  the  number  of 
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flag  symbols  you  think  vere  on  the  slide.  Then  make  a  check 
mark  in  one  of  the  five  scale  rectangles  on  your  answer  sheet  to 
show  how  certain  or  uncertain  you  feel  about  the  correctness  of 
your  answer.  When  you  are  finished,  turn  the  page  to  the  next 
answer  sheet  and  wait  until  the  experimenter  announces  "next 
slide".  Again  focus  your  attention  on  the  center  of  the  screen 
until  the  next  slide  appears,  after  which  you  fill  out  the 
answer  sheet  for  slide  number  2  and  then  prepare  for  another 
slide.  This  procedure  will  be  followed  until  you  have  viewed 
a  total  of  18  slides,  and  filled  out  13  answer  sheets.  I  will 
now  present  a  sample  slide  to  give  you  a  better  idea  of  your 
task.  If  you  have  any  questions,  please  raise  your  hand.” 

After  the  Instructions  were  read  (subjects  also  had  a  printed  copy  of 
the  instructions  before  them  to  refer  to),  a  practice  trial  was  given  and 
subjects  had  an  opportunity  to  ask  questions.  When  the  subjects  appeared 
to  have  adequately  understood  the  instructions,  the  test  session  began. 

The  testing  session  consisted  of  the  presentation  of  l8  slides.  Half  the 
subjects  received  9  slides,  one  at  each  amount  level,  at  500  ms  (order  A) 
followed  by  the  same  9  slides,  presented  upside  down,  at  200  ms.  The  re¬ 
maining  l6  subjects  received  the  first  9  slides  at  200  ms  followed  by  the 
same  slides  upside  down  at  500  ns  (order  B).  The  sequence  of  presentation 
of  the  slide  material  was  independently  randomised  for  each  of  the  groups. 
The  five-category  scale  was  similar  to  that  reportedly  used  by  previous 
experimenters  (Kaufman  et  al,  1949;  Taves,  194l).  It  was  end -anchored 
only  with  "absolutely  uncertain"  on  the  left  end  and  "absolutely  certain" 
on  the  right.  Total  elapsed  time  for  each  test  session  was  approximately 
15  minutes. 


STATISTICAL  ANALYSIS 


Measures  of  dependent  variables  obtained  were: 


1.  Error  Score.  The  relative  error  score  took  into  account  the 
absolute  difference  between  the  subject's  estimate  of  the  number  of  symbols 
in  a  slide  and  the  actual  number  of  symbols  presented  in  the  slide,  accord¬ 
ing  to  the  formula: 


Error  Score 


True  number  -  estimated  number 
True  Number 


x  100 


2.  Estimated  number  of  symbols. 

3.  Certitude.  Ordinal  score  (l  -  5)  on  the  certitude  scale. 

The  error  scores  were  used  as  the  basic  data  for  the  analysis  of 
variance.  The  data  collected  from  the  five -point  scale  on  how  certain  or 
uncertain  the  subjects  felt  about  the  correctness  of  the  answer  were  simi¬ 
larly  analyzed.  In  addition,  the  degree  of  relation  between  certitude  and 
error  score  was  estimated  by  correlational  analysis. 
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RESULTS 


The  distribution  of  error  scores  was  found  to  be  positively  skewed, 
and  logarithmic  transformation  was  performed  to  normalize  the  distribution. 
Results  of  the  analysis  of  variance  on  the  transformed  error  scores  are 
presented  in  Table  1.  Significant  differences  in  performance  were  associ¬ 
ated  with  amount  of  symbols  presented  and  exposure  time.  Neither  order 
effects  nor  any  of  the  interaction  effects  were  found  to  be  significant. 


Table  1 

ANALYSIS  OF  VARIANCE  FOR  ERROR  SCORES  (TRANSFORMED) 


Source  of  Variation 

d.f. 

Mean 

Square 

F 

P 

Order  of  presentation  (0) 

1 

1.33 

•  99 

N.S. 

Btw  S' s  within  order  S  (0) 

30 

1-35 

Exposure  Time  (T) 

1 

2.53 

11.00 

.01 

T  x  0 

1 

•  07 

•  50 

N.S. 

T  x  S  (0) 

30 

.25 

Amount  (Number  of  symbols)  (A) 

8 

8.01 

28.61 

.01 

A  x  0 

8 

•  25 

.82 

N.S. 

A  x  S  (0) 

240 

.28 

A  x  T 

8 

.41 

1.46 

N.S. 

A  x  T  x  0 

8 

.19 

.68 

N.S. 

A  x  T  x  S  (0) 

240 

.28 

A  Q  C  6  - 

NT  ;.S 

y 

-Jon  For  / 

C  . L  /I 

TOTAL 

575 

1  L\ 1  Ti 

_ >  n . . 

s 
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AMOUNT'  (NUMBER  OF  SYMBOLS)  AND  PERFORMANCE 

The  nature  cf  the  statistically  significant  differences  associated  with 
number  of  symbols  per  slide  is  depicted  in  Figure  1  where  mean  error  score 
is  plotted  for  each  amount  level  for  the  two  exposure  times.  Except  for 
seemingly  inappropriately  high  error  scores  for  6  and  7  symbols  in  the  200  ms 
condition,  increase  in  symbol  amount  produced  an  increase  in  error  score. 

The  apparent  discontinuity  in  the  curve  at  the  6- and  the  7-Gyrabol  amounts 
seems  to  interrupt  an  otherwise  positive  relationship  between  number  of 
symbols  and  error  score .  Error  score  at  both  6  and  7  is  greater  than  at  8; 
and  at  7  is  almost  as  great  as  at  10.  When  the  6-  and  7 “symbol  slides  were 
examined  closely,  the  symbols  appeared  more  widely  separated  than  in  other 
slides  in  the  series.  Using  average  distance  of  the  symbols  from  fixation 
point  (center  of  slide;  as  a  dispersion  score,  the  7-symbol  slide  was  found 
to  have  an  average  dispersion  approximately  1-1/2  times  greater  than  in  the 
3-symbol  slide,  a  larger  dispersion  than  for  any  of  the  other  slides  except 
the  18-symbol  slide.  Likewise,  the  6  symbol  slide  had  greater  dispersion 
than  any  of  the  other  slides  except  the  7-  and  18 -symbol  slide.  This  dis¬ 
persion.  increases  the  probability  of  more  of  ihe  slide  being  subject  to 
peripheral  vision.  Fixation  time  or  time  of  saccadic  movement  between  two 
fixations  has  been  found  average  lip  ms  (Woodworth  and  Schlosberg,  1956, 
page  502.''.  T.  ref  ore,  _•  the  200  ns  c.mdition  there  was  time  for  only  one 
fixation,  and  any  stimules  peri f  eral  no  the  foveal  image  would  remain 
peripheral  and  thus  mire  difficult,  to  detect.  The  poor  performance  in  the 
7-synbol  vendition  rould  h&vi  \  r.  .  a  fu-ctlon.  of  this  circumstance.  If  so, 
the  500  as  condition  (wh,-.  :  there  was  time  for  two  fixations)  would  not  have 
suffered  as  much  by  t>.  g.v  .-a+.er  symbol  dispersion.  An  examination  of  Figure  1 
supports  this  hypoh.vr.s  ’  and  thus  tends  to  confirm  that  the  rather  inconsist¬ 
ently  high  error  score  7  symbols  may  have,  been  a  function  of  ar.  unfortunate 

choice  of  slide  to  repr  .  c  .  the  7 -symbol  amount.  Though  less  pronounced, 
the  slightly  smaller  error  at  22  symbols  than  at  18  may  he  attributable  to 
the  same  cause.  To  summarize  the  relationship  between  amount  and  error  score, 
as  the  number  of  sym-: •- 1-:  slide  .'..'.'.creased,  error  score  tended  to  increase, 

from  approximately  5"'-0 $  error  at  4  symbols  to  25-30$  error  at  22  symbols. 

Figure  2  presents  uiw  median  number  of  symbols  estimated  by  the  32 
subjects  (separately  for  each  exposure  time)  for  each  symbol  amount  presented. 
The  dotted  line  represents  the  actual  number  of  symbols  presented.  When  4 
symbols  were  presented,  the  subjects  reported  correctly;  however,  from  5 
symbols  on,  subjects  overestimated.  At  about  18  symbols,  estimates  started 
getting  lower  until  at  22  symbols  (for  500  ms)  the  median  estimate  was  close 
to  the  true  amount.  At  22  symbols  at  200  ms  exposure  time,  the  median 
estimate  was  even  lower  and,  in  fact,  represented  an  underestimate  of  the 
true  symbol  amount.  Previous  studies  using  dots  as  stimulus  material 
(Kaufman,  et  al,  194-9;  M intern  and  Reese,  1951;  Taves,  194l)  showed  similar 
functions  when  median,  estimated  number  was  plotted  against  presented  number, 
except  that  estimates  were  more  accurate  and  generally  lower  than  in  the 
present  study.  In  the  Kaufman  study,  using  dots  as  the  stimuli,  up  to  5 
were  reported  correctly,  from  6  to  9  dots  the  reports  were  overestimates, 
and  above  10  dots  the  reports  were  underestimates.  Although  visual  angle 
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Figure  1.  Mean  Error  Score  at  Each  Amount  Level  for  Two  Exposure  Times 


200  ms 
500  ms 
True  Amount 


Figure  2.  Median  Number  of  Symbols  Estimated  at  Each  Arr?-int  Level  for  Two  Exposure  Times 


was  not  stated  in  the  Kaufman  (1949)  study,  it  was  possible  to  estimate 
from,  information  given  the  approximate  range  of  visual  angles  subtended  by 
stimulus  materials.  These  ranged  from  2°  with  the  lower  numbers  of  dots  to 
approximately  10°  with  the  larger  numbers.  The  visual  angle  subtended  by 
the  visual  image  in  the  present  study  was  considerably  larger  (22°);  there¬ 
fore,  it  was  not  unrea.  onatle  to  expect  the  present  task  to  be  more  diffi¬ 
cult.  However,  the  similarity  of  the  findings  in  spite  of  the  stimulus 
differences  is  striking.  This  similarity  is  also  reflected  in  percent 
error  data;  in  previou:  studies  (Mintern  and  Reese,  195I;  Taves,  194-1;  and 
Kaufman  et  al,  194-9)  and  ir.  the  present  study,  error  increased  in  much  the 
same  manner  as  a  function  of  the  increase  in  amount  presented. 

Along  with  this  error  increase,  'Taves  (l94l),  Mintern  and  Reese  (1951), 
and  Kaufman  et  al  (194 9)  found  an  increase  in  variability  of  response  with 
an  increase  in  amount  presented.  Although  military  symbols  were  used  in 
the  present  study  and  dots  in  the  previous  studies,  a  similarity  exists  in 
the  relationship  between  variability  in  estimated  number  of  symbols  and 
number  presented  in  the  present  study  and  in  earlier  studies  mentioned 
above.  Figure  3  shows  that  variability  increased  slowly  up  to  approximately 
8  symbols  and  then  more  rapidly  to  22  symbols.  This  is  typical  of  previous 
f ladings . 

The  subjects  in  the  present  study  later  took  part  in  an  experiment,  in 
which  they  were  to  recall  an  aspect  of  the  perceptual  organization  of  the 
military  symbols  used  it  the  present  Study.  The  symbols  were  presented  for 
one  minute.  A  mere  detailed  account  of  the  experiment  can  be  found  in  R ingel 
and  Vicino  (1964).  This  circumstance  permitted  comparison  of  performance 
by  the  same  subjects  in  three  perceptual  tasks,  two  tachistoscopie  and  one 
nontachi-toscopio.  Spearman ' s  rank  order  correlation  based  or.  error  scores 
was  calculated  between  rankings  at  the  two  exposure  times  in  the  tachisto- 
scopic  study  and  between  each,  of  these  rankings  end  the  ranking  of  the  same 
subjects  on  the  nor.tachir tosoopi?  task.  For  performance  at  200  ns,  correla¬ 
tion  between  the  tachistoscopie  and  the  rontachistoscopic  tasks  was  r  =  .Jl; 
at  500  ms,  it  was  r  -  .43.  Both  correlation  coefficients  were  rather  low 
considering  the  similarity  in  stimulus  material  ana  ambient  conditions.  The 
probability  of  predicting  relative  success  from  one  task  to  the  other  is  low 
enough,  to  introduce  considerable  caution  in  generalizing  from  the  results  of 
a  tachistoscopie  study  to  one  where  more  time  is  allowed  to  view  the  stimulus 
materials.  The  rank  order  correlation,  coefficient  between  tachistoscopie 
tasks  at  500  and  200  ms  was  . 56 --again  rather  low  for  tasks  with  the  same 
stimulus  material,  the  same  ambient  conditions  and,  in  this  case,  the  same 
task. 


EXPOSURE  TIME  AND  PERFORMANCE 

Significant  differences  were  found  for  the  effects  of  exposure  time  on 
error  score.  Higher  percent  error  (Figure  l)  and  greater  variability  in 
estimated  number  of  symbols  (Figure  3)  associated  with  the  200  ms  condition 
than  with  the  500  ms  condition  were  found  and,  as  mentioned  above,  correla¬ 
tion  between  performance  at  the  two  time  conditions  was  not,  as  high  as 
expected. 
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Figure  3.  Variability  in  Estimated  Number  of  Symbols  as  a  Function  of  Amount. 


One  possible  explanation  for  the  differences  in  error  score  at  the  two 
exposure  times  is  the  same  as  that  advanced  earlier  to  explain  irregularity 
in  the  error  score  curve.  Approximately  200  ms  is  the  average  reaction  time 
of  the  eyes  in  shifting  from  one  fixation  point  to  another.  Therefore,  with 
time  for  only  one  fixation,  there  can  be  only  one  "act  of  attention"  and 
serial  counting  cannot  occur.  The  500  ms  exposure  allows  for  two  fixations, 
more  of  the  slide  area  may  be  exposed  to  foveal  vision,  and  some  form  of 
counting  may  begin.  As  shown  in  Figure  1,  the  percent  error  score  was  con¬ 
siderably  greater  at  200  ms  than  at  500  ms  for  up  to  approximately  7  sym¬ 
bols.  Beyond  7  symbols,  the  task  was  difficult  enough  so  that  two  fixa¬ 
tions  did  not  enhance  the  performance  at  500  ms  with  any  consistency. 
Although  at  the  18-  and  22-symbol  level,  a  more  realistic  estimate  of  the 
number  of  symbols  was  made  at  the  longer  exposure  time,  the  difference  was 
relatively  small  in  terms  of  total  error.  In  the  present  task,  the  visual 
angle  was  approximately  22°.  The  present  analysis  led  to  the  hypothesis 
that  the  differences  between  200  ms  and  500  ms  would  not  occur  if  the 
visual  angle  of  the  display  were  2°  or  less,  which  would  allow  for  foveal 
vision  so  that  no  more  than  one  fixation  would  be  needed.  The  test  of  this 
hypothesis  awaits  an  experiment  where  visual  angle  and  exposure  time  are 
varied  and  discrimination  accuracy  measured  for  all  possible  combinations. 


EXPOSURE  TIME  ORDER  AND  PERFORMANCE 

There  were  no  significant  differences  as  a  function  of  order  of  ex¬ 
posure  time  (Table  l). 

Allowing  the  subjects  to  respond  to  the  stimuli  at  the  500  ms  exposure 
first  did  not  affect  error  score  any  differently  than  allowing  them  to  re¬ 
spond  first  at  200  ms.  Practice  effects  were  therefore  virtually  nonexistent 
for  the  discrimination  of  visual  number  in  the  present  tachistoscopic  task. 


CERTITUDE  AND  NUMEROUSNESS 

A  three-way  analysis  of  variance  with  amount,  exposure  time,  and  order 
of  exposure  time  as  the  treatment  classifications  and  certitude  as  the 
dependent  variable  was  performed  on  the  data.  Ordinal  values  of  1  to  5, 
"absolutely  uncertain"  to  "absolutely  certain",  were  used  in  the  analysis 
since  the  data  could  not  be  fitted  to  the  successive  category  scaling  model, 
thus  precluding  a  determination  of  scale  values  for  the  intervals.  The 
summary  of  the  analysis  of  variance  shown  in  Table  2  reveals  order  of  ex¬ 
posure  time  as  the  only  main  effect  which  was  not  statistically  significant. 
In  addition  to  the  significant  amount  and  exposure  time  effects,  there  was 
one  significant  interaction,  amount  x  time.  The  nature  and  magnitude  of 
these  effects  are  more  easily  discernible  in  Figure  4. 
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Table  2 

ANALYSIS  OF  VARIANCE  FOR  CERTITUDE  JUDGMENTS 


Source  of  Variation 

d.f . 

Mean 

Square 

F 

P 

Order  of  presentation  (0) 

1 

6.46 

.96 

N.S. 

Btw  Subjects  in  order  S  (0) 

30 

6.76 

Exposure  Time  (T ) 

1 

10.84 

12.81 

• 

0 

H 

T  x  0 

1 

.50 

•  59 

N.S. 

T  x  S  (0) 

30 

Amount  (Number  of  symbols)  (A) 

8 

64.45 

97.16 

.01 

A  x  0 

8 

•  23 

.34 

N.S. 

A  x  S  (0) 

240 

.66 

A  x  T 

8 

I.05 

4.04 

.01 

A  x  T  x  0 

8 

.42 

1.6l 

N.S. 

A  x  T  x  S  (0) 

240 

.26 

TOTAL  575 


The  shape  of  the  function  for  me  or.  certitude  at  200  ms  and  500  ms  ex¬ 
posure  times  are  very  similar.  As  expected,  for  each  exposure  time,  subjects 
were  most  certain  of  their  responses  when  the  number  of  symbols  on  the  slide 
was  smallest  and  their  certitude  decreased  at  a  nearly  constant  rate  up  to 
7  symbols.  Then,  curiously,  certitude  did  not  decline  from  7  to  8  symbols 
at  500  ms  exposure  and  actually  increased  at  200  ms.  More  about  this  later. 
From  7  through  l8  symbols,  certitude  continued  to  decline  but  at  a  decreas¬ 
ing  rate.  There  was  no  further  decline  from  18  to  22  symbols  at  200  ms; 
however,  at  500  ms,  certitude  was  still  gradually  declining  at  22  symbols. 

For  all  amounts  starting  at  4,  subjects  were  more  certain  at  the  500  ms  ex¬ 
posure  than  at  200  ms.  However,  differences  in  certitude  between  the  two 
exposure  times  became  progressively  smaller  until  at  l8  there  was  no  differ¬ 
ence  and  at  22  more  certainty  was  expressed  for  the  shorter  exposure  time. 
Plotting  medians  instead  of  means  (Figure  5  )  to  reduce  the  effect  of  ex¬ 
treme  scores  did  not  change  the  shape  of  the  function  to  any  appreciable 
degree,  except  that  coincidence  of  the  200  ms  and  500  ms  exposure  times 
occurred  at  both  14  and  18  symbols. 

Amount  by  time  interaction  appears  to  have  occurred  mainly  at  the  18- 
and  22-symbol  conditions .  This  finding  is  not  explainable  by  performance, 
since  at  the  22-synbol  condition,  there  was  a  higher  percentage  of  error 
for  the  200  ms  exposure  than  for  the  500  ms.  A  possible  explanation,  based 
on  the  tendency  for  the  two  certitude  functions  to  converge,  is  that  beyond 
a  given  number  of  symbols  the  task  of  estimation  is  sc  difficult  that  the 
small  benefits  attributable  to  difference  in  expos  tire  time  are  not  reflected 
in  confidence.  Beyond  that  point  one  exposure  would  not  produce  consistently 
greater  confidence  than  the  other. 

The  general  shape  of  the  functions  for  the  8-  through  22-symbol  con¬ 
ditions  shown  in  Figure  5  for  both  200  as  and  500  ms  is  similar  to  results 
reported  in  the  literature  (Tavas,  1941;  Kaufman  et  al,  1949).  Below  8 
symbols,  however,  findings  from  the  AFRO  study  are  less  consistent  with 
previous  findings.  Typically,  experimenters  have  found  that  median  certi¬ 
tude  hovers  at  or  near  the  upper  limit  (absolutely  certain)  up  to  about  5 
stimuli.  From  the  5~stlmu.ll  level  to  the  6-stimuli  level,  certitude  then 
drops  off  sharply  in  much  the  same  manner  as  from  the  5-  to  4-stimuli  level 
in  the  present  experiment.  This  discontinuity  of  function  has  given  rise 
to  the  postulation  of  two  separate  mechanisms,  one  covering  perception  of 
numerousness  and  associated  certitude  up  to  about  5  stimuli  and  the  other 
numerousness  and  associated  certitude  beyond  5  stimuli.  If  a  discontinuity 
of  function  parallel  to  that  previously  found  is  to  be  extracted  from  the 
present  data,  it  will  have  to  be  via  extrapolation.  Such  an  estimate  would 
place  the  point  of  discontinuity  at  about  3  symbols  for  the  500  ms  exposure 
and  at  about  2  symbols  for  the  200  ns  exposures,  thereby  tending  to  confirm 
the  notion  of  two  perceptual  mechanisms  but  indicating  that  the  disconti¬ 
nuity  demarcating  the  eliange  from  one  mechanism  to  the  other  can  occur  at 
other  than  5  or  6  stimuli  depending  or.  the  conditions  imposed.  Since  the 
certitude  functions  pretty  much  conformed  to  the  shapes  of  the  error  func¬ 
tions,  the  probable  reason  for  the  disparity  in  location  of  the  disconti¬ 
nuity  between  AFRO  findings  and  results  of  previous  certitude  studies  is 
found  in  the  explanation  adduced  for  the  disparity  in  error  of  estimate 
functions. 
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Figure  5.  Median  Certitude  as  a  Function  of  Number  of  Symbols  Displayed  for  Two  Exposure  Times. 


While  Figures  4  and  5  seer:  to  offer  evidence  of  another  discontinuity 
at  about  the  7-symbol  level,  the  irregularity  is  unlike  any  discontinuity 
found  in  previous  studies.  Tint  it  is  really  a  discontinuity  is  doubtful 
since  if  the  7-symbol  condition  were  emitted,  the  total  function  from  4 
through  22  symbols  would  be  relatively  smooth  and  continuous.  Again.,  the 
probable  reason  for  this  seeming  discontinuity  is  the  similar  apparent  dis¬ 
continuity  in  the  error  score,  reason  for  which  has  been  exposited.  The 
same  reason  probably  accounts  for  the  inflection  between  18  and  22  symbols. 


CERTITUDE  AMD  ERROR  SCORE 

The  general  conformity  of  the  certitude  function  to  the  error  score 
function  may  belie  the  relationship  between  the  individual's  perception  of 
number  and  his  certitude  about  the  accuracy  of  Ms  perception  In  terms  of 
the  product  moment  correlation.  Based  on  288  observations  (9  for  each  of 
32  subjects),  the  correlation  coefficient  obtained  between  certitude  and 
error  score  was  -.30  at  the  500  ms  exposure,  and  -.35  for  the  same  number 
of  observations  at  200  as  exposure,  indicating  that  as  error  increased, 
certitude  decreased.  Yet  when  the  between  people  effects  (tendency  for 
correlation  to  be  Inflated  or  depressed  because  of  Individual  differences) 
were  partialed  out  of  these  correlation  coefficients,  that  portion  of  the 
correlation  attributable  to  within  people  effects  produced  an  r  of  -.88  for 
the  500  ms  exposure  and  an  r  of  -.58  for  the  200  ms  exposure.  Apparently, 
shorter  time  exposure  had  more  of  an  effect  on  a  man's  perception  of  his 
performance  than  it  had  on  his  actual  performance. 

Within  the  present  study,  a  good  range  of  difficulty  was  represented 
by  the  conditions  imposed:  numerousness  levels  covered  the  most  critical 
range,  judging  from  previous  studies  and  from  the  numbers  of  symbols  that 
might  be  displayed  simultaneously  in  an  operations  center.  In  addition, 
the  performance-; -certitude  frequency  distributions  at  200  ms  exposure  time 
were  quite  similar  to  those  at  ^00  ms.  It  would  thus  appear  reasonable  to 
conclude  that  the  degree  of  relationship  between  performance  and  confidence 
in  that  performance  can.  vary  considerably  depending  upon  the  conditions 
imposed  (500  ms  vs  200  ms).  There  also  appears  to  be  considerable  varia¬ 
tion  across  subjects  in  the  certitude  they  assign  to  a  given  performance 
level,  judging  by  the  magnitude  of  the  increase  in  correlation  when  between 
people  effects  were  removed. 

No  direct  treatment  of  the  certitude -performance  relationsMp  was  found 
in  reported  research  in  which  discrimination  of  visual  number  and  certitude 
measures  were  taken.  However,  the  study  which  followed  the  present  one  did 
involve  such  comparisons  (Andrews  and  Ringel,  1964).  The  task  was  different 
and  stimuli  were  not  presented  tachistoscopically,  but  since  both  studies 
involved  extraction  of  information  from  displays  and  subjective  feelings  of 
certitude  about  the  accuracy  of  the  extraction,  the  similarities  and  dis¬ 
similarities  in  the  findings  are  of  interest. 
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Correlation  of  r  = . *.55  between  error  and.  certitude  was  obtained  for 
the  within  person  effects  in  the  Andrews  and  R ingel  study  compared  to 
r  =  -.88  and  r  =  -.5 8  obtained  in  the  present  study.  The  between  person 
effects  obtained  were  r  =  .50  (Andrews  and  Ringel)  and  r  =  .18  and  r  ■=  -.22 
(present  study).  The  contrasting  results  seem  to  indicate  that  people 
differences  can  vary  widely  depending  on  the  nature  of  the  task  and  diffi¬ 
culty  levels  within  a  task. 

The  relationship  can  be  looked  at  another  way.  At  the  500  ms  ex¬ 
posure,  there  were  6o  "absolutely  certain"  responses,  of  which  78$  were,  in 
fact,  correct.  There  were  109  correct  responses,  only  43$  of  which  received 
the  "absolutely  certain"  response.  At  the  200  ms  exposure,  there  were  32 
"absolutely  certain"  responses,  of  which  59$  were  actually  correct,  and  86 
correct  responses,  only  22$  of  which  received  the  "absolutely  certain" 
response.  These  figures  indicate  greater  probability  that  a  man  will  be 
right  in  his  estimate  when  he  says  he  is  "absolutely  certain"  than  there 
is  that  he  will  say  he  is  "absolutely  certain"  when,  in  fact,  he  is  right. 
This  is  logical  since  on  many  occasions  a  man  knows  his  answer  is  only  an 
approximation,  albeit  a  close  approximation,  and  thus  is  not  absolutely 
certain  though  in  fact  he  may  be  right.  So,  too,  with  outright  guesses. 

The  relationship  described  above  holds  for  both  the  200  ms  and  500  ms  ex¬ 
posures,  though  a  man  is  more  likely  to  be  wrong  when  he  says  "absolutely 
certain"  and  less  likely  to  say  "absolutely  certain"  when  he  is  right  at 
the  200  ms  exposure  than  at  the  500  ms. 

Addressing  the  question  whether  individuals  tend  to  have  a  pattern  of 
certitude  consistently  higher  or  lower  than  other  individuals  irrespective 
of  their  actual  performance  on  the  task,  Spearman  rank  order  correlations 
based  on  mean  certitude  rank  for  the  200  ms  exposure,  the  500  ms  exposure, 
and  the  nontachistoscopic  presentation  were  computed.  The  results  are  as 
follows : 


r200  ms  500  ms  * ' ' 
r200  ms  NT.  = 
r500  ms  HT.  =  *51 

Only  the  last  of  these  is  not  significant  at  the  .05  level.  As  would 
be  expected,  highest  correlation  was  between  the  two  tachistoscopic  tasks. 
Not  so  expected  was  the  higher  relationship  of  the  200  ms  exposure  than  the 
500  ms  to  the  nontachistoscopic  task,  particularly  since  the  reverse  was 
true  in  terms  of  actual  error.  It  would  seem  that  to  the  extent  these  dif¬ 
ferences  are  not  attributable  to  chance,  there  are  more  aspects  in  common  to 
the  200  ms  and  nontachistoscopic  tasks,  apart  from  accuracy  of  performance, 
which  contribute  to  feelings  of  certitude.  While  there  may  be  some  tendency 
for  one  individual  to  be  consistently  more  or  less  certain  than  others,  the 
magnitude  of  this  relationship  apparently  can  vary  considerably  across 
differing  tasks. 
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THE  CERTITUDE  CONTINUUM 


One  final  aspect  that  warrants  at  least  a  cursory  look  is  the  response 
continuum  itself.  As  mentioned  previously,  data  from  the  five-interval 
certitude  continuum  ve re  not  scalable  by  the  method  of  successive  cate¬ 
gories.  Why  this  was  so  for  this  continuum  and  not  for  the  certitude 
continuum  used  in  the  Andrews  and  Ringel  study  (1964)  is  difficult  to 
ascertain.  Apparently,  there  was  more  nonrandom  error  in  the  present 
study.  Whether  this  is  attributable  to  differences  in  the  nature  of  the 
task,  differences  in  the  continuum,  (eight-category  fully  anchored  vs  five- 
category  end  anchored),  some  ccmbinntion  of  these  two  factors,  or  other 
unspecified  causes,  could  not  be  determined.  Ilor  does  the  literature  re¬ 
port  any  scaling  data  on  the  certitude  continuums  used.  In  information 
theory  parlance,  2.28  "bits"  of  response  information  were  provided  by  the 
five -category  continuum  and  2.85  "bits"  by  the  eight -category  continuum. 

In  amount  of  inf ormntion  provided  as  a  proportion  of  the  amount  that  could 
be  provided  by  continuums  of  these  lengths  (relative  entropy),  Rg  =  .98  for 

the  five-category  scale  and  Re  =  .95  for  the  eight -category  continuum. 

Bendig  and  Hughes  (1953),  in  a  study  of  the  effects  of  anchoring  and  number 
of  scale  categories  on  transmitted  information,  found  that  their  five- 
category  scale  produced  2.22  bits  of  information  and  an  Re  =  .96.  Thus, 

the  five-category  continuum  used  in  the  present  study  appears  not  to  be 
deficient  in  terms  of  "bits"  of  response  information.  Certainly,  no  fewer 
than  five  categories  are  indicated  for  judgments  of  this  type.  More  than 
five  categories  could  probably  be  used  effectively,  since  the  five-category 
scale  produced  near  the  upper  limit  of  response  information  possible  for 
the  length  of  scale,  and  the  eight -cate gory  scale  in  the  other  study  was 
also  producing  close  to  the  maximum  possible.  While  there  is  nothing  in 
the  evidence  to  recommend  the  five -category  continuum  over  the  eight,  there 
is  at  least  probable  evidence  to  recommend  the  eight-  over  the  five-category 
continuum. 


IMPLICATIONS  OF  FINDINGS 

By  intent,  the  present  study  is  of  value  chiefly  in  terms  of  the  impli¬ 
cative  rather  than  definitive  nature  of  the  results  obtained.  First,  dis¬ 
crimination  of  visual  numerousness  functions  appears  to  be  relatively  immune 
to  the  form  characteristics  of  the  stimulus — dots,  circles,  military  symbols, 
etc.  The  implication  is  that  the  perceptual  mechanisms  reported  in  the 
literature  for  less  meaningful  stimuli  can  be  postulated  for  symbolic  dis¬ 
plays  of  military  content.  Similarly,  the  shape  of  these  functions  is 
relatively  unaffected  by  the  visual  angle  (involving  other  than  foveal 
vision)  subtended  by  the  display  area  or  by  differences  in  exposure  time 
as  represented  by  two  caramon  tachistoscopic  exposure  times.  Again,  the 
implication  is  that  the  previously  reported  mechanisms  operate  with  visual 
angles  approaching  those  expected  in  command  systems  displays  and  without 
regard  for  whether  exposure  time  permits  a  saccadic  eye  movement,  as  long 
a3  the  time  is  sufficient  to  subitize  or  to  estimate  but  not  to  count. 
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When  the  interest  of  ar.  experiment  is  in  come  absolute  measure  of 
performance - -accuracy,  error  rate,  etc# --rather  than  general  shape  of  the 
performance  function,  it  is  important  to  treat  each  neu  or  changed  variable 
or  condition  imposed  as  a  different  entity  whose  specific  values  are  yet  to 
be  determined.  This  is  implied  from  the  finding  that  error  or  accuracy  can 
vary  as  a  function  of  time  and  perhaps  visual  angle  even  though  the  nature 
of  these  relationships  to  numerousness  is  highly  similar. 

The  foregoing  implications  also  apply  to  certitude  as  used  In  this 
study.  An  additional  implication  which  is  derived  from  direct  correlational 
analysis  of  the  certitude -accuracy  relationship  is  that  degree  of  relation¬ 
ship  can  vary  widely  as  a  function  of  the  task  imposes,  and  is  not  necessarily 
associated  with  the  apparent  similarity  of  the  tasks.  Thus,  the  certitude- 
accuracy  relationship  is  not  generalizable  but  must  be  determined  separately 
for  each  task  which  differs  in  any  dimension  from  any  previously  analyzed 
task.  It  cannot  be  assumed  that  certitude,  response  continuums  alleged  to 
be  adequate  in  previous  studies  without  quint -sac ive  analysis  or  determined 
merely  on  some  logical  basis  will  have  the  desired  psychometric,  informa¬ 
tion  transmittal,  or  sensitivity  properties.  Such  assumptions  could 
severely  limit  the  information  obtained  and  the  staticticil  manipulations 
permitted. 

There  are  a  number  of  implications  for  further  research  but  these  are 
more  germane  to  basic  questions  left  unanswered  in  +hc  experimental  literature 
on  visual  processes  than  they  are  to  the  operationally  oriented  program  of 
research  planned  in  the  Command  Systems  Task.  For  example,  a  definitive 
study  on  the  effects  of  visual  angle,  to  include  both  foveal  and  peripheral 
vision,  on  discrimination  of  visual  number  would  answer  questions  raised  but 
left  unanswered  by  the  present  study.  Closely  related  would  be  an  investiga¬ 
tion  of  the  effects  of  average  deviation  of  stimulus  figures  from  the  focal 
point  in  a  slide  (or  from  foveal  vision)  at  various  levels  of  numerousness. 
Saccadic  eye  movement  ar.d  discrimination  as  a  function  of  varying  time 
exposure  would  also  bear  scrutiny . 


-  19  - 


REFERENCES 


Andrews,  R.  S.  and  Ringel,  S.  Certitude  judgaents  and  accuracy  of  informa 
tion  assimilation  in  visual  displays.  Technical  Research  Note  145-  May 
1964. 

Bendig,  A.  W.  and  Hughes,  J.  B.  Effects  of  amount  of  verbal  anchoring  and 
number  of  rating  scale  categories  upon  transmitted  information.  Journal 
of  Experimental  Psychology,  146,  1955 ,  87 -90. 

Kaufman,  E.  L. ,  Lord,  M.  W.,  Reese,  T.  W.,  and  Volkman,  J.  The  discrimina 
tion  of  visual  number.  American  Journal  of  Psycholog/,  1949*  PP  498-525. 

Minturn,  A.  L.  and  Reese,  T.  W.  The  effect  of  differential  reinforcement 
on  the  discrimination  of  visual  number.  American  Journal  of  Psychology, 
1951,  31,  PP  201-231.  . .  ' 

Ringel,  S.  and  Vicino,  F.  L.  Information  assimilation  from  symbolic 
displays --Amount  of  information  presented  and  removed.  Technical  Research 
Note  139*  March  1964. 

Saltzman,  I.  J.  and  Garner,  W.  R.  Reaction  time  as  a  measure  of  span  of 
attention.  American  Journal  of  Psychology,  1948,  25,  pp  227-241. 

Taves,  E.  H.  Two  mechanisms  for  the  perception  of  visual  numerousness. 
Archives  of  Psychology,  1941,  pp  5-46. 

Woodworth,  R.  S.  and  Schlosberg,  H.  Experimental  Psychology.  New  York: 
Henry  Holt  and  Campary,  1958. 


